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Abstract 

Background: In 2012, in The Netherlands a multidisciplinary practice guideline for the assessment and treatment of 
suicidal behavior was issued. The release of guidelines often fails to change professional behavior due to multiple 
barriers. Structured implementation may improve adherence to guidelines. This article describes the design of a 
study measuring the effect of an e-learning supported Train-the-Trainer program aiming at the training of the full 
staff of departments in the application of the guideline. We hypothesize that both professionals and departments 
will benefit from the program. 

Method: In a multicenter cluster randomized controlled trial, 43 psychiatric departments spread over 10 regional 
mental health institutions throughout The Netherlands will be clustered in pairs with respect to the most prevalent 
diagnostic category of patients and average duration of treatment. Pair members are randomly allocated to either 
the experimental or the control condition. In the experimental condition, the full staff of departments, that is, all 
registered nurses, psychologists, physicians and psychiatrists (n = 532, 21 departments) will be trained in the 
application of the guideline, in a one-day small interactive group Train-the-Trainer program. The program is 
supported by a 60-minute e-learning module with video vignettes of suicidal patients and additional instruction. In 
the control condition (22 departments, 404 professionals), the guideline shall be disseminated in the traditional 
way: through manuals, books, conferences, internet, reviews and so on. The effectiveness of the program will be 
assessed at the level of both health care professionals and departments. 

(Continued on next page) 
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(Continued from previous page) 

Discussion: We aim to demonstrate the effect of training of the full staff of departments with an e-learning 
supported Train-the-Trainer program in the application of a new clinical guideline. Strengths of the study are the 
natural setting, the training of full staff, the random allocation to the conditions, the large scale of the study and 
the willingness of both staff and management to participate in the study. 

Trial registration: Dutch trial register: NTR3092 

Keywords: Guideline, Implementation, Suicide prevention, Train-the-trainer, E-learning, Healthcare professionals 



Background 

Suicide is a significant public health issue representing 
1.8% of the global burden of disease [1]. The Netherlands 
ranks among the lower rates with 9.4 suicides per 100,000 
inhabitants or approximately 1,500 to 1,600 cases annually 
[2]. Around 44% of these suicides involve patients in con- 
tact with mental health care services [3]. There is limited 
consensus on how to assess and treat suicidal patients [4]. 
As a consequence, suicidal patients may not always re- 
ceive evidence-based care [5,6]. The Dutch Ministry of 
Health, Welfare and Sports (VWS) commissioned the de- 
velopment of an evidence-based multidisciplinary practice 
guideline for the assessment and treatment of suicidal be- 
havior (further abbreviated PGSB), which was issued in 
early 2012 [7]. Adherence to guidelines, however, is not 
self-evident, due to multiple barriers at both professional 
and organizational levels. An extensive systematic review 
of implementation studies identified many barriers at both 
levels, such as lack of knowledge, and poor outcome ex- 
pectations at the professional level. Material support, fun- 
ding and time were found to be common barriers at the 
organizational level [8]. 

Grol and Grimshaw found that structured implementa- 
tion can improve adherence to guidelines [9]. They argue 
that behavior change is more likely when the intervention 
is tailored to specific settings and target groups. 

A recent systematic review of psychiatric practice 
guidelines found a modest effect of guideline imple- 
mentation on provider performance and patient out- 
come [10]. The authors argue that ongoing support 
and feedback are effective in changing professional be- 
havior. As suicide prevention in mental health care is 
essentially the work of multidisciplinary teams [7], and 
teamwork plays an important role in ensuring patients' 
safety and avoiding errors [11], it is advised to train in 
multidisciplinary teams and to train the full staff of the 
team [11,12]. When implementing guidelines in a me- 
dical setting, a combination of small group interactive 
postgraduate training, including personalized feedback, 
and additional instruction material, such as a website, 
was found to be more successful than a single-faceted 
intervention [9,13,14]. Finally, e-learning is said to com- 
plement face-to-face training in a medical setting; it was 



found to help medical students become more actively 
involved in the study material and thereby help to in- 
ternalize the material [15,16]. 

Combining these findings, we developed a practical 
and multifaceted, small interactive group, e-learning sup- 
ported Train-the-Trainer program (TtT-e) to be deli- 
vered to full staff of the departments called PITSTOP 
suicide (Professionals In Training to STOP suicide). Its 
content reflects the PGSB. The method of instruction is 
role play with personalized feedback and instructions by 
the trainers. The content of the role plays is tailored by 
the trainers to the specific patient category with which 
the trainees work on a daily basis in their respective 
departments. The Train-the-Trainer model of small group 
interactive educational training is based on Adult Learning 
Theory [17], which states that people who train others re- 
member 90% of what they teach others, and on the Diffu- 
sion of Innovation Theory stating that people adopt new 
information better through their trusted social networks 
[18]. The effectiveness of a Train-the-Trainer model is 
expected since the profits of training by peer-assisted 
learning in medical health education are comparable 
to those achieved by professional teachers [19-24]. The 
Train-the-Trainer program is supported by an e-learning 
module to complement and prolong the effect of the 
training. 

The PITSTOP suicide study is a cluster randomized 
controlled trial examining the effect of the TtT-e pro- 
gram on adherence to the PGSB compared with re- 
gular guideline dissemination (that is, easy access to 
guidelines from websites of involved associations, re- 
views in clinical journals, presentation at conferences, 
books and manuals), further abbreviated IAU (imple- 
mentation as usual). The effects are to be examined 
at the professional and departmental level. We hypo- 
thesize that attitudes, knowledge, skills, competence 
and confidence of mental health care professionals to- 
wards suicidal behavior are more likely to improve by 
the application of the TtT-e program (further abbre- 
viated IAU + TtT-e) than by IAU. Further, we hypo- 
thesize that the application of IAU + TtT-e results in 
better guideline adherence at a departmental level than 
IAU. 
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Method 

Design 

This is a multicenter cluster randomized controlled trial 
in which different psychiatric departments from multiple 
mental health institutions are clustered and randomized. 

Mental health institution 

A mental health institution (MHI) is a regional organi- 
zation that hosts many different psychiatric departments. 
In The Netherlands there are 30 MHIs spread through- 
out the country. Each MHI has its own catchment area 
of patients and its own professionals [25]. For example, 
in 2011, MHI Rivierduinen had a catchment area of 1.1 
million people within an area of approximately 1,500 
square kilometers in the region of South Holland. MHI 
Rivierduinen hosted 44 different psychiatric departments 
that together treated 24,753 patients and employed 2,726 
employees [26]. 

Psychiatric department 

A psychiatric department is an independent unit within 
an MHI. It is an organizational unit with its own ma- 
nagement and professional structure. Employees do not 



work in two departments at the same time. Within one 
department, patients with various diagnostic categories 
are treated. However, most departments have one pri- 
mary diagnostic category that they treat the most, such 
as depression or personality disorders. 

Recruitment 

Recruitment of MHIs took place during meetings and 
conferences on suicide prevention in The Netherlands in 
the two years before the study started. Attending profes- 
sionals were invited to participate with their MHI in the 
study. When MHIs expressed willingness to participate, 
they were requested to indicate at least two departments 
for inclusion. The MHIs were explicitly asked to provide 
departments that were hosted in separate buildings or 
on separate locations with the assurance that staff mem- 
bers were not exchanged or shared in between the depart- 
ments, to prevent possible exchange of training material. 
This resulted in 43 participating departments distributed 
over 10 MHIs (Figure 1). 

Departments for adult patient care (>18 years) that were 
willing to participate were considered eligible for inclusion 
if: a) the need for training in suicide prevention skills is 
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62 professionals 
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Figure 1 Overview of the 10 MHIs. Annotated are the number of departments and the total number of professionals attending PIT5TOP 
suicide per MHI. 



de Beurs ef al. Trials 2013, 14:9 
http://www.trialsjournal.eom/content/14/1/9 



Page 4 of 10 



acknowledged by both the team of professionals and b) by 
the department's management, and c) actively supported 
by the board of the MHI; d) departments are prepared to 
deal with the demands made by the study (production loss 
due to the training, requirements for data collection, time 
needed to study the e-learning module and so on, willing- 
ness to be randomized and acceptance of a 50% change of 
being trained immediately, and a 50% change of a delay of 
training; e) departments are prepared to meet the demand 
of 100% participation of individual professionals in multi- 
disciplinary training sessions; f) participating departments 
were located at separate locations, and that personnel was 
not exchanged between departments (for example, depart- 
ments do not share the same psychiatrist). 

Each department eligible to join our study was asked 
to give the following information: prevalence of diag- 
nostic categories, average treatment duration of patients 
in days, number of new patients admitted a year, and 
number of registered professionals. For example, an out- 
patient department of MHI Propersona reported that 
70% of their patients have a diagnosis of depression, 10% 
a diagnosis of borderline, 5% a diagnosis of somatoform 
disorder, and that 15% have other diagnoses. They treat 
200 new patients a year with a team of five psychologists, 
five psychiatrists and two nurses. The average treatment 
duration is 365 days. An overview of the information pro- 
vided by the departments per MHI is shown in Table 1. 

In sum, 936 professionals from 43 participating 
departments are registered to participate in the study 
(222 psychiatrists, 130 psychologists, 536 nurses, 48 not 
defined). Various types of mental health care depart- 
ments are represented in the study (in- and out-patient 
care, acute crisis units and long stay departments) treat- 
ing patients of various diagnostic categories (personality 
disorder, depressive disorder, anxiety disorder, psychotic 
disorder). 

Matching procedure 

1) The first criterion for matching departments was the 
most prevalent main diagnostic category. For instance, a 
department that reported that 60% of their patients had 
a main diagnosis of depression was matched with an- 
other department that reported a comparable percentage 
of depressive patients. 2) Within groups with compar- 
able diagnostic categories we matched the departments 
with comparable average treatment duration of patients. 
We assumed that departments who treat similar types of 
patients for a similar duration of time are most likely to 
be comparable on the level of suicidality of their pa- 
tients. A total of 34 departments were matched according 
to this procedure. 3) The remaining nine departments 
differed in a mix of diagnostic categories of patients 
from other departments so they could not be matched 
according to the diagnostic criterion. We matched these 



departments according to comparable treatment duration. 
We wanted all interested departments that met our inclu- 
sion criteria to be able to join the study. By doing so, our 
study contains a representative sample of all Dutch psy- 
chiatric departments that deal with suicidal patients. In 
the final analysis we will study the sample with and with- 
out these last nine departments. We have sent all the pairs 
to an independent researcher not involved in the study to 
perform randomization of the matched pairs. Results of 
the matching procedure and the randomization can be 
found in Table 2. As our study is performed in a naturalis- 
tic setting, we could not match the departments as one 
can do in a laboratory situation. Still, we believe that our 
matching procedure is the best possible procedure we 
could use given the real life conditions. As we matched 
according to diagnostic criterion and treatment duration, 
the number of professionals might be uneven as the de- 
partments also differed in the number of professionals. A 
matching procedure where we matched departments on 
the number of professionals did not work because then 
the treatment duration and patient categories were unba- 
lanced between pairs. Because of the large number of de- 
partments and professionals included in our study we 
expect that the difference between the number of profes- 
sionals in the experimental and control conditions will be 
acceptable. We do not think this will have an influence on 
the results. 



Intervention 

In the TtT-e program, three types of participants are 
involved: masters, trainers and trainees. Training is ap- 
plied on two levels: first, trainers are trained by masters. 
Subsequently, trainees are trained by trainers. All trai- 
ning sessions are supported by an e-learning module. 
The TtT-e program as applied by masters is similar to the 
program applied by trainers. 

Masters are experts in the field of suicide prevention 
due to scientific performance and clinical practice. Trai- 
ners are mental health care workers of various disciplines 
(psychiatrists, psychologists or mental health nurses). 
They are selected by their management from the clinical 
staff of departments participating in the PITSTOP-study. 
Trainers have good training skills, know how to direct role 
plays, are prepared to train their co-workers and have 
been selected to serve as a role model on an institutional 
level and to provide future additional training after all 
training sessions in the study have been completed. Im- 
portantly, they are able to tailor the role plays of the TtT-e 
program to the needs of the specific patient category of 
their department. The trainers are instructed to combine 
the content of the TtT-e program with actual cases from 
their units. After the study, trainers are expected to con- 
tinue their role as experts in suicide prevention skills, 
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Table 1 Information received from departments 

Overview departments 



MHI Delfland 



department 


profs 


Nurse 


Psycho 


MD 


average treatment 


main diagnosis 


inpatient 


11 


8 


0 


3 


1,532 


Depression 


outpatient 


24 


7 


9 


7 


624 


Depression 


Inpatient 


13 


11 


0 


2 


1,308 


Depression 


Older persons 


16 


9 


10 


8 


740 


Depression 


MHI Parnassia 














department 


profs 


N 


Psy 


MD 


average treatment 


main diagnosis 


Older persons 


59 


36 


0 


23 


21 


Depression 


inpatient 


63 


50 


0 


13 


16 


Depression 


inpatient 


29 


18 


9 


2 


250 


Personality 


Older persons 


110 


80 


9 


21 


41 


Depression 


outpatient 


8 


5 


0 


3 


90 


Depression 


crisis centre 


47 


28 


0 


19 


1 


Depr/bord/crisis 


inpatient 


36 


29 


0 


7 


missing 


Depression 


outpatient 


8 


0 


2 


6 


240 


Addiction 


Older persons 


22 


14 


3 


5 


730 


Depression 


Older persons 


32 


19 


5 


8 


700 


Depression 


Older persons 


12 


7 


3 


2 


371 


Depression 


MHI Eindhoven 














department 


Profs 


N 


Psy 


MD 


average treatment 


main diagnosis 


outpatient 


9 


0 


4 


5 


150 


Depression 


Inpatient 


32 


25 


0 


7 


104 


Depression 


outpatient 


16 


14 


0 


2 


300 


Personality 


MHI Vincent van Gogh 














department 


Profs 


N 


Psy 


MD 


average treatment 


main diagnosis 


outpatient 


13 


10 


1 


2 


172 


Personality 


neuropsychiatry 


22 


14 


4 


4 


96 


Mood disorders NOS 


inpatient 


17 


14 


0 


3 


20 


Schizophrenia 


outpatient 


13 


10 


0 


3 


54 


Personality 


MHI Dimence 














department 


Profs 


N 


Psy 


MD 


average treatment 


main diagnosis 


inpatient 


16 


1 1 


0 


4 


90 


Depression 


outpatient 


13 


4 


7 


2 


400 


Personality 


outpatient 


9 


2 


5 


2 


400 


Depression 


outpatient 


5 


2 


0 


3 


1 


Depr/bord/crisis 


MHI Altrprht 
ivini MIllcLIll 














department 


Profs 


N 


Psy 


MD 


average treatment 


main diagnosis 


Older persons 


20 


18 


0 


2 


42 


Depr/bord/crisis 


Older persons 


42 


26 


9 


7 


150 


Depr/bord/crisis 


MHI Friesland 














department 


Profs 


N 


Psy 


MD 


average treatment 


main diagnosis 


Older persons 


24 


22 


0 


2 


582 


Depression 


Older persons 


18 


11 


2 


5 


814 


Depression 


Older persons 


7 


6 


0 


1 


743 


Depression 


Older persons 


7 


4 


1 


2 


602 


Depression 
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Table 1 Information received from departments (Continued) 



MHI Pro Persoona 



department 


Profs 


N 


Psy 


MD 


average treatment 


main diagnosis 


outpatient 


1 z 


Q 

y 


n 
U 




i 
i 


Dcpr/bord/crisis 


outpatient 


1 J 


A 
*\ 


u 


Q 

y 


i 


Dopr/bord/crisis 


outpatient 


1 3 
1 J 


J 


c 

j 


c 


j DO 


Depression 


MHI Rivierduinen 














department 


Profs 


N 


Psy 


MD 


average treatment 


main diagnosis 


eating disorders 


31 

o I 


u 




Q 

o 


1 sn 


Esting disorders 


r\ o i* c r\ n 3 1 i t\ / 
pel jUI la ii Ly 


20 


3 


9 


3 


270 


r ci jU i id 1 1 Ly 


inpatient 


15 


13 


0 


2 


35 


Depression 


personality 


10 


5 


3 


2 


240 


Personality 


crisis center 


10 


Missing 


missing 


Missing 


Missing 


Depr/bord/crisis 


Outpatient 


20 


Missing 


missing 


Missing 


Missing 


Personality 


MHI de Viersprong 














department 


Profs 


N 


Psy 


MD 


average treatment 


main diagnosis 


personality 


14 


6 


5 


3 


244 


Personality 


personality 


5 


1 


2 


2 


240 


Personality 



Prof total number of professionals; W number of nurses; Psy, number of psychologists; MD number of medical doctors; average treatment, average treatment 
duration of patients in days. 



since on-going support and feedback when implementing 
psychiatric guidelines are likely to be effective [10]. 

The TtT-e program reflects the Dutch multidisciplinary 
guideline on the assessment and treatment of suicidal be- 
havior [7]. The guideline combines the stress-diathesis 
model [27] and the entrapment model of suicidal behavior 
[28] to explain the onset and maintenance of suicidal be- 
havior. The combined model depicts suicidal behavior as 
the outcome of a process that is influenced by the in- 
teraction of biological, psychological, environmental and 
situational factors the interaction of which may lead 
to entrapment. Entrapment is defined as the specific situ- 
ation that characterizes suicidal behavior and the specific 
emotional condition of it. The empirical evidence for the 
PGSB reflects the international reviews [29-32] . 

The TtT-e program is supported by two e-learning 
modules. The first module is developed for the trainees. It 
consists of video vignettes in which experienced nurses, 
psychologists and psychiatrists interact with suicidal pa- 
tients, played by actors, to teach the guideline recommen- 
dations. The role playing characters are of various ages, 
gender and diagnostic categories and they display pro- 
totypical suicidal symptoms, cognitions and interaction 
problems. In between vignettes, guideline topics and re- 
commendations are explained by masters (that is, experts 
on the topic). Trainees have personalized access to the 
e-learning module, which can be viewed repeatedly. The 
total running time of the module is 60 minutes. 

In addition to the e-learning module for all the trai- 
nees, a second e-learning module was developed speci- 
fically for trainers. It provides a video tape of the first 



training session provided by masters to trainers which 
was processed into an e-learning format that allows trai- 
ners to review the exercises. All trainers were instructed 
to follow the training protocol manual when training 
trainees. To survey the adherence to the TtT-e program 
of trainers, graduate students will randomly visit training 
sessions. They rate the adherence on a Likert type scale. 
The scores will be used as a covariate when analyzing 
the effects of the training. 

The difference between an experimental and a control 
department is that the full staff of the experimental 
department is trained and the staff of the control depart- 
ment is not trained. The training itself cannot be ex- 
changed between these departments since it consists of 
a one day training including role playing and direct feed- 
back. What we do not want to be exchanged are the 
e-learning module, the PowerPoint presentation and 
written training materials. Professionals in the interven- 
tion condition are clearly instructed not to share or dis- 
tribute training materials with peers, particularly not with 
peers that work in the control departments. Also, access 
to the e-learning module is protected with a personalized 
login code. 

Measurements 

The study design and assessment schedule are summar- 
ized in Figure 2. The effect of IAU + TtT-e versus IAU will 
be assessed at the level of professionals and departments. 

A link to the assessment will be sent to participants by 
e-mail. Each participant will be asked to provide an on- 
line informed consent form before entering the study. 
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Table 2 Results of the matching procedure per department 



Result matching 


MHI 


nonartmont 
L/cpoi LI 1 ICl 1 1 


Axrorano troatmonf 
nvciauc u ca Li I ici I L 


IV/I a i n Hianttrtcic 
iv id ii i uidui iujIj 


C n n H it i n n 

\_UI IU 1 1 IUI 1 


Profs 


Delfland 


Inpatient 


1,532 


Depression 


EXP 


1 1 


Dplfland 
L/tri I idi iu 


I nriatipnt 

I I IUd LICI 1 L 


1 308 


Rprirpccinn 

L7CUI CJJIUI 1 


CON 


13 


L/CI 1 I d 1 IU 


itri^tipnt 

UU LUd LICI 1 L 


624 


Pip n rp c: c i r> n 
L7CUI CjjIUI 1 


EXP 


24 


D i m onro 

L/l 1 1 1 Cl H.C 


ill itri^tipnt 

UU LUCt LICI I L 


600 


ripnrpccifin 

L7CUI CJJIUI 1 


CON 


g 


Parnassia 


Outpatient 


21 


Depression 


CON 


59 


r dl 1 ldbbld 


1 1 ipd LICI 1 L 


1 6 


L/Cpi CjjIUI 1 


EXP 


63 


i_/ tr 1 1 idi iu 


("lIHpr nprc"r\nc: 

UIUCI UCI JUI 1 J 


740 


Pi ci n r p c: c i r\ n 

L7CUI CJJIUI 1 


CON 


16 


Parnaccia 
r al I icijjla 


uiuci uci jui i j 


730 


p) p n r ci c c I r\ n 

L/CUI CJJIUI 1 


EXP 


22 


r i uuci juiia 






P)p nr/hn rn /rTi<u\ 

L/C Ul / UU U/ U_ 1 LJIJ 


CON 


12 


Prnnorcnna 
r i upci sui id 




] 


P)cir~!i"/rir~\rH A- ride 

UCLil / UU U/ L.I 1 J 1 J 


EXP 


13 


Parnassia 


Inpatient 


250 


Personality 


EXP 


29 


Di manra 

L/l 1 1 ICl ll_C 


Pprcz-inp 1 it\/ 
r ci jui id I i Ly 


400 


Pprcnnia 1 ir\/ 
r ci jui id 1 1 Ly 


CON 


13 


Dirnence 


Crisis 


1 


Depr/bord/crisis 


EXP 


5 


Parnaccia 
r al I lajjia 




] 


P)prir/Kr\rH Ariclc 

L/CUI / UU U/ L.I 1 J 1 J 


CON 


47 


Friesland 


Older persons 




Depression 


EXP 


24 


i I Itrjld I iu 


f^lHpr nprenne 

UIUCI UCI jUI Ij 


814 


p) a n r ci c c I r\ n 

UCU CJJIUI 1 


CON 


18 


Fripc 1 and 

1 1 ICjIuI iu 


OIHpt npr^nn^ 

U [UCI UCI jUI Ij 


743 


Pipnrp^^inn 

L/C Ul CjjIUI 1 


EXP 


7 


1 1 ICJlOl IU 


f^lHpr ncircr\nc 

UIUCI UCI jU 1 j 


602 


Pip n tp c c I n n 
UCU CjjIUI 1 


CON 


3 


Parnassia 


Outpatient 


90 


Depression 


EXP 


8 


rdr 1 ldbbld 


III it 3"t"i o nt 
UULpdLlcl IL 


21 


P^ci rcic c ifin 
L/CpiCjilUi 1 


CON 


36 


Vipr^ nrnnn 

V ICl 3 V*J 1 Ul IU 


Pprcnn^lirv 
r ci i id i i l y 


240 


Pprcnn^litU 
r ci ju i id 1 1 Ly 


CON 


5 


Fir\/Hhr*wpn 

til IUI IUVCI 1 


Pprcnna I itv 
r ci jui id 1 1 Ly 


300 


Pprcnn^ 1 it\/ 
r ci jui id 1 1 Ly 


EXP 


16 


FinHhnvpn 

L 1 1 IUI IUVCI 1 


Oi itn^tipnt 

UULUdLICI IL 


150 


P)pnrp^^inn 

L'CUICJjIUI 1 


CON 


9 


F i ri/H h rtwp n 

til IUI IUVCI 1 


I nriatipnt 

I I IUd LICI I L 


1 04 


L/CUI CjjIUI I 


EXP 


32 


Rivierduinen 
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Average treatment, average treatment duration of patients in days; EXP experimental condition; COW control condition; Profs total number of professionals. 
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departments of MHFs 
n=43 in 10 MHFs 



Matching in pairs: 21 
clustered pairs 



randomization 
of pair members 



IAU* + II I c 



n= 21 departments 
n= 532 professionals 



TO 

baseline assessment 
before the training sessions 



e-learning supported training 
sessions 



Tl 

follow-up immediately after the 
training 



T2 

follow-up at three months after 
the training 



IAU* 



n= 22 departments 
n=404 professionals 



TO 

baseline assessment 



T2 

follow-up at three months 
after the training of the 
experimental group 



Figure 2 PITSTOP SUICIDE study design. * IAU, implementation as usual. ** TtT-e, e-learning supported Train the trainer program. 



After completing baseline assessment (TO), participants 
in the intervention condition have access to the one-day 
training session and the e-learning module. Follow-up as- 
sessment takes place immediately after the training (Tl) 
(participants in the intervention condition) and, subse- 
quently, at three months (T2) after the training. To pro- 
mote attendance of all professionals in the experimental 
teams, professional credits, necessary to become or to re- 
main registered as a professional, are awarded. 

Measures at professional level 

Measures at professional level concern skills, knowledge, 
confidence and attitudes of professionals. All scales have 
been translated into Dutch. 

Self-evaluation of knowledge will be assessed by a sub- 
scale of the 14-item QPR questionnaire (Question, per- 
suade, refer questionnaire [33]). The subscale has been 
found to measure differences in how professionals rate 
their knowledge of suicide prevention before and after trai- 
ning [33,34]. Example: "How do you rate your knowledge 



on suicide prevention?" Scores range from l(very low) to 5 
(very high). 

Provider confidence and beliefs is assessed by a six- 
item questionnaire (Confidence and Beliefs Questions 
[35]) that has been shown to be able to measure changes 
in confidence in suicidal behavior management (for ex- 
ample, T am confident in my ability to successfully assess 
a suicidal patient'). Scores range from 1 (not confident 
at all) to 5 (very confident). 

The ability of professionals to recognize the appropri- 
ate response to suicidal patients was measured with the 
validated 25-item translation [36] of the Suicide Interven- 
tion Response Inventory-version 2 (SIRI-2) [37]. Partici- 
pants have to rate the appropriateness of two "helper" 
responses on a "client" remark. Rating ranges from -3 
(not appropriate at all) to 3 (very appropriate). We use a 
Visual Analogue Scale instead of the scoring from -3 to 3 
to make the SIRI more user-friendly for on-line use. 

Guideline adherence by professionals is established by 
having participants respond to video vignettes in which ex- 
perienced nurses, psychologists and psychiatrists interact 
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with suicidal characters, played by actors. The video frag- 
ments last 30 seconds. Then, professionals are asked to 
rate the likelihood that they would respond with any of 
the 25 different interventions on a Visual Analogue Scale 
(ranging from 1 to 100). For example: 'Ask whether the pa- 
tient thinks about suicide^ Ask how hopeless the patient is 
feeling'. At TO, Tl and T2, the same vignettes are dis- 
played. An expert panel of masters who were involved in 
the guideline development will also complete the video 
vignettes. Their scores will serve as reference scores for 
"excellent guideline adherence". Scores of participants in 
the intervention group will be compared with scores of 
the control group, and with 'Excellent guideline adhe- 
rence' scores of masters. The smaller the difference bet- 
ween the scores by the expert panel and the participant, 
the better the participant scores on guideline adherence. 

Guideline adherence at departmental level will be as- 
sessed in both the control and experimental condition 
one year after the experimental group of the matched 
pair has completed the PITSTOP intervention. This will 
be done by NEDKAD (the Dutch Knowledge Center for 
Anxiety and Depression). For over four years, NEDKAD 
examines adherence to psychiatric guidelines in different 
MHIs and departments, using a specific protocol of 10 
questions, for example, 'To what extent is the staff in- 
formed about the guideline?' and 'How are guideline re- 
commendations translated into practice?' The NEDKAD 
procedure is a well-known protocol in The Netherlands 
for examining guideline adherence in mental health care. 
It is used as an instrument to assess guideline adherence 
for the treatment of anxiety and depression. As such, it is 
used as a regular independent assessment of the quality of 
care of departments specialized in the treatment of anxiety 
and depression. It is accepted by the Dutch MHI centers. 
Ten questions are being answered and scored by two in- 
dependent assessors. The approach has not yet been pub- 
lished. We aim to further develop and systematize the 
instrument for measuring adherence to the suicide guide- 
line. We will collaborate with NEDKAD. 

Statistical analysis 

Our study is a design with different levels. For the out- 
comes on the professional level we have repeated obser- 
vations (level 1) that are nested within trainees (level 2). 
Trainees are nested within trainers (level 3), trainers 
within departments (level 4) and departments are nested 
within MHIs (level 5). For the analysis on an organiza- 
tional level we have departments that are nested within 
MHIs. Multilevel models are hierarchal systems that es- 
timate random coefficients and variance components for 
each level. Random intercepts will be included in the mul- 
tilevel models [38]. 

Approval from the Medical Ethics Committee of the VU 
University Medical Center (registration number 2011/151) 



was requested and obtained. We have sent the advice from 
the Medical Ethics Committee to the ethical committees 
of the participating departments so they could give their 
own reaction. All other committees agreed with the Ethics 
Committee of the VU. 

Discussion 

This paper describes the study protocol of a cluster 
randomized controlled trial measuring the effects of a 
practical and multifaceted, e-learning supported Train- 
the-Trainer model at the professional and departmental 
level. Strengths of the study are the natural setting, the 
training of the complete staff in the experimental condi- 
tion, the random allocation to dissemination conditions, 
the large scale of the study, and the willingness of both 
staff and management to participate in the study. 

Spill-over of training material to the control conditions 
is a potential risk of our design. By making sure that ex- 
perimental and control departments are on different lo- 
cations and do not share personnel, by restricting the 
e-learning module with a personal login code and by ins- 
tructing trainees not to spread any material among peers 
in the control condition, we minimize contamination. 

Up until now, willingness of both management and 
employees to participate in the TtT-e program is excel- 
lent. Boards of the participating centers provided con- 
sent and reserved time to elaborate upon the project 
with the research team. The first training was given in 
January 2012, and the final training will be given around 
November 2012. Results will be available in the begin- 
ning of 2013. 

We included many different departments in our study. 
What all departments have in common is that they have 
a bottom-up wish for improving their skills in suicide 
prevention. From the literature we know that this is an 
important factor for success [12]. As a result of this stu- 
dy, we will know that for groups with a bottom-up need 
for training and top-down support, PITSTOP suicide is 
or is not an effective method to implement the guideline 
among professionals. 
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